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Section  1 
INTKODIJCIIUN 


The  Strategic  Avionics  Battle-Management  Evaluation  and  Research  (SABER) 
facility  was  developed  by  the  Human  Engineering  Division  of  the  Armstrong 
Aerospace  Medical  Research  Laboratory  (AAMRL)  to  support  exploratory 
research  and  development  efforts  concerning  the  evolution  and  refinement  of 
advanced  multiplace  aircraft  crew  system  concepts  (Wilson  anj  Kuperinan, 
1988).  SABER  exploits  the  responsiveness  and  flexibility  of  rapid  proto¬ 
typing  tools  and  graphics  display  processors.  SABER  permits  the  crewsta- 
tion  designer/human  factors  practitioner  to  develop  display  formats  and 
crew  interface  concepts  from  an  abstract  design  to  a  fully  interactive  sta¬ 
tion,  and  does  so  through  a  low  cost,  minimum  time  process.  Thus,  SABER 
provides  an  integrated  design  process  that  begins  with  static  display  con¬ 
cepts  and  ends  with  demonstration/validation  using  full  mission,  man- 
in-the-loop  simulations. 

SABER  was  developed  to  provide  quantitative  and  qualitative  crew  system 
design  data  early  in  the  development  process  (Kuperman  and  Wilson,  1986). 
The  SABER  facility  and  process  is  employed  to  provide  weapon  system  devel¬ 
opment  agencies  with  data  in  three  general  areas:  (1)  crew  workload,  as  a 
function  of  crew  size,  allocation  of  tasks  to  crew  position  and  level  of 
subsystem  automation,  (2)  crew  situational  awareness,  as  a  ''unction  of 
mission  phase  and  external /i nternal  events,  and  (3)  crew  training  require¬ 
ments,  with  regard  to  both  skill  requirements  and  proficiency  levels. 

SABER  is  designed  to  fully  capture  the  real-time  experimental  data  that 
will  support  each  of  these  three  areas. 

This  document  reports  on  the  development  and  test/deinonstration  of  one 
component  of  the  SABER  crew  workload  test  capability:  psychophysiological 
correlates  of  crew  workload.  This  report  presents  a  description  of  these 
measures,  describes  a  version  of  the  AAf^RL  Neuropsychological  Workload  Test 
Battery  (NWTB)  modified  specifically  for  SABER,  and  presents  methods  and 
results  of  an  off-line  (non-SABER)  simulation  experiment  which  served  to 
verify  the  correct  functioning  of  the  modified  NWTB.  It  is  hoped  that  the 
presentation  of  these  data  and  the  documentation  of  tiie  NWTB  modifications 
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will  facilitate  future  applications  of  toe  NWTB  in  the  SABER  laboratory. 
(The  physiological  workload  correlates  themselves  are  described  in  the 
Appendix. ) 
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Section  2 

SIMULATION  AND  DEMONSTRATION 


OVERVIEW 

A  small  scale  flight  task  simulation,  with  an  NWTli  (Wilson,  and  O'Donnell, 
1988),  was  obtained  for  the  SABER  laboratories.  The  investigation  had  as 
its  main  objectives: 

1.  Test  the  interface  between  the  simulation  and  the  NWTB  (identify 
problem  areas  and  correct  them). 

2.  Determine  the  feasibility  of  collecting  physiological  data  during 
simulation  (cost-effectiveness,  value  of  the  data,  etc.). 

3.  Formulate  recommendations  for  a  larger  simulator  effort  through 
the  experience  of  the  small  scale  simulation. 

These  three  objectives  were  all  met  to  some  degree  in  the  effort  reported 
below.  A  description  of  the  NWTB  used  to  obtain  physiological  measures  is 
followed  by  a  description  of  the  ‘..ilicon  Graphics  IRIS  simulation  (and 
pertinent  segments  of  the  "DOG"  flight).  The  problems  found  during  the 
interface  of  these  two  hardware  and  software  systems  (the  NWTB  and  the 
flight  simulation)  are  summarized.  The  experimental  methods  used  to  obtain 
behavioral  and  physiological  measures  during  the  simulation  are  then  pre¬ 
sented.  The  results  of  these  measures  (behavioral  and  physiological)  are 
discussed  in  terms  of  their  relation  to  flight  parameters. 

Finally,  the  results  of  the  effort  are  used  to  generate  recommendations  for 
a  more  realistic,  full  scale  simulator  investigation  that  will  use  physio¬ 
logical  measures  as  part  of  a  larger  evaluative  data  l)ase. 
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PHYSIOLOGICAL  tlEASURLMENT 


The  NWTB  and  SABER  Requirements 

The  NWTB  was  d.'velopod  to  provide  multichannel  physiological  data  collec¬ 
tion  and  analysis  within  one  self-contained  measurement  apparatus.  In  the 
past,  collecting  multiple  physiological  measures  required  multiple  hardware 
and  software  configurations  to  handle  such  diverse  responses  as  heart  rate 
(electrocardio'jraphy--ECG) ,  eyeblink  (electrooculography — EOG),  and  elec¬ 
troencephalography  (LEG).  Furthermore,  these  separate  configurations  were 
governed  by  widely  different  signal/response  characteristics.  Such  things 
as  gains,  offsets,  sample  rates,  etc.,  varied  dramatically  between  sig¬ 
nals.  Researchers  found  separate  analysis  of  measures  necessary  (i.e., 
overlapping  analysis  not  possible).  The  governing  hypotheses  required  to 
make  assumptions  about  measures  and  their  relationship  with  workload  also 
varied  distinctly.  Each  measure  required  a  separate  "study"  in  both 
research  design  requirements  and  governing  hypotheses.  The  NWTB  was 
designed  to  eliminate  a  large  part  of  these  problems.  The  NWTB  is  a  stan¬ 
dardized  system  with  well  defined  assumptions  that  can  be  used  by  laymen 
and  physiological  experts  alike  (Wilson  and  O'Donnell,  198B). 

The  NWTB  has  a  POP  11/73  central  processing  unit  that  independently  con¬ 
trols  six  analog  to  digital  (A/D)  channels  which  are  assigned  as  follows: 
three  EEG  channels,  one  EC3,  one  EOG,  and  one  electromyography  (EMG-- 
muscle).  The  NWTB  has  13  programming  modules  that  digitize,  store,  and 
analyze  daij: 

EEG:  1.  Oddball  task  (audio  and  visual). 

2.  Memory  scanning  (Sternberg,  audio  and  visual). 

3.  Continuous  performance. 

4.  Flash  evoked  response. 

5.  Monitoring  task. 

6.  Tracking  task. 

7.  Brain  stem  response. 

8.  Checkerboard  steady  state  response. 

9.  Sine  wave  steady  state  response. 
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10.  Unpatterned  flash  steady  state  response. 

ECG:  11.  R-wave  identification  and  time-based  measurement. 

EOG:  12.  Blink  identification  and  time-based  measurement. 

EMG:  13.  Power  of  muscle  spectra  in  frequency  domain. 

The  NWTB  was  originally  designed  for  collection  of  data  from  only  one 
operator  for  limited  periods  of  time  (1  hour).  This  1-operator/l-hour 
limitation  was  not  acceptable  for  use  in  the  SABER  laboratories.  SABER 
requirements  were  such  that  data  collection  included  a  2-operator  scenario 
for  a  period  of  up  to  6  hours.  Furthermore,  physiological  data  were  to  be 
digitized  and  stored  during  the  entire  6-hour  period  (the  or'ginal  NWTB 
stored  data  in  discrete  time  blocks).  This  not  only  required  huge  amounts 
of  memory  to  be  added  to  the  NWTB  capability,  but  also  extra  programming 
modules  that  allowed  marking  of  the  time  series  and  transfer  of  the  perti¬ 
nent  data  segments  from  memory  to  the  original  NWTB  format  for  analysis. 

The  following  section  of  this  report  discusses  in  detail  the  problems  of 
interfacing/integrating  the  NWTB  with  an  off-line  simulation  that  possessed 
requirements  identical  to  those  of  the  SABER  laboratories. 

The  Modified  Neuropsychological  Workload  Test  Battery 

The  NWTB  was  modified  to  accommodate  studies  in  the  SABER  laboratories,  in 
which  lengthy  data  collection  could  last  up  to  (>  hours  for  two  subjects  at 
a  time.  A  two-step  approach  was  employed.  First,  the  problem  of  data 
collection  was  addressed. 

Because  a  large  quantity  of  data  could  potentially  be  collected,  8  more 
disc  surfaces  were  added  to  the  NWTB  to  increase  storage  capability  to 
120  Mbytes.  Ten  analog  to  digital  (A/D)  channels  were  available  for  col¬ 
lecting  and  storing  data.  Two  of  the  10  channels  were  dedicated  to  heart 
rate  collection  and  sampled  at  a  1  KHz  rate  (4  Kbytes/second,  240  Kbytes/ 
minute,  14.4  Mbytes/hour,  and  86.4  Mbytes/total  test  capability).  Two 
channels  were  dedicated  to  eyeblink  collection  and  sampled  at  a  100  Hz  rate 
(8.64  Mbytes/total  test  capability).  Six  channels  were  dedicated  to  EEG 
collection  and  sampled  at  a  200  Hz  rate  for  intermittent  3-minute  periods 
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(432  Kbytes/peri od  and  17.28  Mi)ytes/40  jieriods).  Total  data  collection 
capability  for  all  10  channels  was  112.32  Mbytes.  (NOTE:  The  actual 
memory  space  required  for  the  present  study  was  negligible  and  did  not 
approach  the  maximum  capacity  of  the  modified  NWTB;  for  each  subject,  one 
cliannel  of  heart  rate,  eyeblink,  and  EEG  data  were  collected  for  very  short 
periods  of  time,  i.e.,  under  1  hour  continuous  for  one  subject.) 

The  next  step  was  to  arrange  the  data  into  a  format  that  could  be  presented 
to  the  standard  NWTB  hardware  and  software  for  analyses.  Extra  A/D  con¬ 
verters  were  added  to  the  NWTB  to  accommodate  the  two  channels  of  heart 
rate  data.  A  software  module  (also  called  SABER)  was  written  to  collect 
heart  rate  and  eyeblink  data.  This  module  also  provided  an  "Audio  Rare 
Event"  (Oddball)  task,  described  later,  identical  to  the  standard  test  on 
the  original  NWTB.  The  m(jdule  transferred  all  collected  digitized  data  to 
the  hard  discs  for  archival  storage.  This  feature  allowed  previously 
collected  test  data  to  be  restored  in  the  modified  NWTB,  ready  for  the  next 
processing  step.  An  IEEE  interface  between  the  NWTB  and  SABER  simulation 
was  provided  for  a  direct  link  concerning  control  and  data  transfer  com¬ 
munications  but  was  not  used  in  the  present  study.  A  second  software 
module  (SABSRT)  was  created  to  allow  the  operator  to  select  position  and 
time  frames  of  physiological  data  that  corresponded  to  specific  flight  seg¬ 
ments.  These  "data  windows"  were  identical  to  standard  NWTB  "*.UAT"  files, 
which  allowed  the  information  to  be  processed  in  the  NWTB  data  reduction/ 
analysis  program  as  usual.  A  third  software  module  controlled  the  gain  and 
filter  settings  of  a  Systems  Research  Laboratories ,  Inc.  (SRL),  program¬ 
mable  ainpl  if  itr/f  i  I  ter.  The  ampl  i f ier/f  i  I  tei  settings  used  in  this  study 
were  as  follows: 


EEG 

EOG 

ECG 

High  Pass: 

0.10 

0.10 

9.65 

Low  Pass: 

29.80 

100.44 

100.44 

Filter  Range: 

32-64K 

4-8K 

1-2K 

Gain: 

50,000 

5000 

2000 

Notch  Filter: 

6011Z 

60Hz 

60Hz 
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In  summary,  hardware  additions  included  8  disc  surfaces,  A/L)  converters  and 
a  10-channel  SRL  amplifier/filter.  The  sequence  of  events  was  as  follows: 
data  were  collected  on  the  NWTB  as  usual,  however,  the  digitized  data  went 
directly  to  the  8  disc  surfaces  that  had  been  added  to  the  NWTB.  After 
data  collection  was  completed,  SABSRT  pulled  windows  of  data  from  the 
discs.  Once  chosen,  these  windows  went  directly  onto  the  standard  NWTB 
removable  5  Mbyte  disc  as  "*.DAT"  files  where  they  could  be  examined  with 
the  standard  NWTB  reduction/analysis  program  modules. 

SIMULATION 

IRIS  Silicon  Graphics  Computer  System 

A  dynamic  flight  mission  using  a  modified  version  of  the  "DOG"  program  [)ro- 
vided  the  task.  The  DOG  software  included  an  option  for  recording  the  fier- 
formance  parameters  (e.g.,  altitude,  velocity)  at  selectable  data  sampling 
rates.  The  hardware  of  the  Silicon  Graphics  Workstation  Model  (IRIS  3030) 
remained  standard.  A  flight  pattern  similar  to  a  simple  oval  circuit  was 
created  with  a  simulated  F-15  aircraft  and  saved  (prerecorded)  on  the  IRIS' 
hard  disc.  This  prerecorded  flight  path  was  sequenced  in  the  following 
manner:  take-off  (TO),  straight  and  level  (SLl),  left  bank  (Bl),  straight 
and  level  (SL2),  left  bank  (B2),  straight  and  level  (SL3),  and  landing 
(L).  An  illustration  of  the  flight  path  is  presented  in  Figure  1.  Each 
segment  of  the  pattern  used  at  least  one  minute's  worth  of  time  to  enable 
EEG  data  collection.  Next,  the  pattern  was  broken  down  into  actual  time; 
windows  that  reflected  each  flight  segment.  Once  the  criterion  flight 
pattern  was  prerecorded  and  timed,  subjects  piloted  a  second  F-15  aircraft 
along  with  the  prerecorded  criterion  aircraft.  The  objective  was  to  fly 
the  second  (wing)  aircraft  1500  feet  or  less  behind  the  first  (lead) 
aircraft,  maintaining  similar  altitude  and  roll  angle.  Unfortunately,  the 
IRIS  update  rate  slowed  down  when  the  wing  plane  was  added  to  the  screen 
with  the  prerecorded  lead  plane,  and  sampling  rate  decreased.  Sampling 
rate  also  became  more  variable  within  each  segment,  and  within  and  between 
each  subject.  When  a  sampling  rate  was  specified,  the  display  made  jerky, 
discrete  movements  instead  of  the  smooth,  continuous  movements  required  for 
simulation.  Because  this  "jerky"  simulation  was  too  difficult  to  fly. 
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LANDING 


Fitjure  1.  Flight  Path  Top  and  Side  Views 


sampling  rate  was  allowed  to  vary  randomly,  resulting  in  about  13  perform¬ 
ance  samples  per  second. 

Specifying  the  lead  and  wing  options  of  the  IRIS  allowed  the  subjects'  wing 
flight  and  the  prerecorded  lead  flight  to  be  recorded  in  a  file  simultane¬ 
ously,  resulting  in  comparable  data  at  the  end  of  a  run.  The  data  showed 
both  aircrafts'  positions  in  the  Z  (longitudinal  trailing  distance), 

Y  (altitude),  and  X  (lateral  off-set  or  roll)  axes  for  each  sample  taken 
(Figure  2).  Thus,  flying  "two"  was  similar  to  a  three  axis  pursuit 
tracking  task. 

Two  programs,  FLIGHT. C  and  COf'lM.C,  which  encompass  the  DOG  i)rogrdin,  under¬ 
went  modifications  to  allow  a  distance  and  heading  display  to  be  placed  on 
the  screen.  Also,  an  additional  modification  of  COt'lM.C  allowed  position 
data  to  be  sent  to  "OUTFILE"  for  viewing. 

NWTB  AND  IRIS  INTERFACE 

The  new  problem  of  the  random  IRIS  sampling  rate  during  simulated  lead/wing 
flight  had  implications  for  the  use  of  the  NWTB  in  the  study.  The  IRIS  ran 
on  variable  software  time  instead  of  real-time.  The  NWTB  ran  on  a  real¬ 
time  clock,  and  problems  appeared  during  correlation  of  NWTB  and  IRIS 
data.  To  solve  these  problems,  an  RS-232  was  employed  to  link  both  systems 
together  to  run  on  the  IRIS'  software  time.  Since  the  software  time  was 
considerably  slower,  the  segments  lasted  longer  than  we  had  originally 
anticipated.  The  segment  start  and  stop  times,  as  well  as  rha  amount  of 
real  time,  are  listed  below. 


Prerecorded  Time 

Start _ Stop  Real  Time 


Take-off 

00:00 

00:59 

01:13 

SLl 

01:00 

02:11 

01:36 

B1 

02:12 

03:12 

01.33 

SL2 

03:13 

06:18 

04:38 

B2 

06:19 

07:21 

01:34 

SL3 

07:22 

08:46 

01:53 

Landing 

08:47 

10:34 

02:16 

9 


Although  the  real  start  and  stop  time  for  each  of  the  flight  segments  was 
known,  the  prerecorded  time  v/as  variable  in  both  interval  between  seconds 
and  length  of  each  second,  because  the  NWTli  used  the  IKIS'  variable  soft¬ 
ware  time,  the  NWTB  could  be  programmed  to  begin  data  collection  at 
00:00:00  when  the  IRIS  clock  began  counting  at  the  start  of  the  flight 
trial.  For  the  EOG  and  ECG,  this  was  not  a  problem  since  the  data  was 
recorded  continuously  and  setting  the  program  parameters  to  collect  this 
type  of  data  was  a  one-step  operation.  However,  for  the  EEG  data  a  real 
logistics  problem  emerged.  During  EEG  collection,  a  secondary  task 
(described  later)  was  presented  and  evoked  potentials  recorded  to  the  onset 
of  the  task  items.  A  window  of  time  during  each  segment  was  chosen  to  pre¬ 
sent  this  secondary  task,  rather  than  attempting  to  collect  continuous 
data.  This  meant  that  each  time  window  block  had  to  be  typed  in  sepa¬ 
rately.  Unfortunately,  the  operator  could  only  input  one  window  at  a  time 
while  collection  was  underway.  This  was  an  extremely  inconvenient  and 
error  prone  situation.  If  the  time  window  block  was  entered  incorrectly, 
and  could  not  be  corrected  by  the  time  the  test  was  due  to  begin,  the 
entire  run  had  to  be  reset  and  restarted.  To  alleviate  this  problem,  the 
NWTB  was  programmed  to  start  counting  from  10:00:00  to  allow  the  operator 
to  type  in  all  the  time  window  blocks  before  the  run  started.  When  the 
task  started,  the  NWTB  time  was  reset  to  10:00:00  and  the  EEG  data  was 
collected  at  time  points  specified  by  the  operator.  (NOTE:  All  the  data 
windows  were  under  00:10:34,  so  it  would  have  taken  the  NWTB  almost 
10  hours  to  count  down  to  the  first  time  window.)  The  starting  times  for 
each  data  window  were  input  as  follows: 


EOG  and  ECG 

LEG 

Take-off 

10:00:03 

10:00:03 

SLl 

10:01:00 

10:01:07 

B1 

10:02:11 

10:02:11 

SL2 

10:05:15 

10:05:15 

B2 

10:06:19 

10:06:11 

SL3 

10:07:22 

lu:07:Z2 

Landing 

10:08:47 

10:09:25 
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EE.j  windows  we:  e  sli  jhtly  jifferent  from  EOG  dnd  ECG  because  the  data  in 
each  window  were  collected  as  discrete  data.  The  window  choices  were  made 
to  optimize  the  effects  of  each  segment.  Each  1  minute  EEG  sample  needed 
to  reflect  the  effects  of  each  segment.  For  example,  "landing"  effects 
would  most  likrly  be  seen  in  the  latter  part  of  the  landing  segment  where 
the  subject's  [lane  was  actually  touching  down  on  the  runway.  Once  the  run 
was  completed  (when  the  leid  plane  stopped  on  the  runway)  the  NWTli  program 
was  halted  and  SAGSRI  was  used  to  sift  through  the  data  for  the  specified 
windows  listed  tove. 


Section  3 
DATA  KEUUCTION 


KEDUCIND  Tilt  IIUS  BEHAVIORAL  DATA 


After  the  behavioral  data  was  sampled  in  binary  fashion,  a  program  was 
written  to  convert  the  data  set  into  American  Standard  Code  for  Information 
Interchange  (ASCII)  format.  This  same  program  further  reduced  the  data 
into  root  mean  square  (RtlS)  error  terms  for  each  of  the  three  axes  (X,  Y 
and  Z).  The  RfiS  formula  used  here  is  presented  below; 


RMS  Error 


The  data  were  sorted  between  subjects  and  by  flight  segment.  The  data  set 
was  then  written  onto  an  ASCII  IRIS.*  file  which  was  compatible  with  SAS. 
These  files  were  transferred  to  a  VAX  8650  via  a  Telnet  cciimunications 
interface.  Once  on  the  VAX  the  data  set  uds  r  .-ady  to  be  statistically 
exami ned. 

REDUCING  THE  NWTB  PHYSIOLOGICAL  DATA 

Analysis  of  the  physiological  data  on  the  NWTB  was  a  very  time  consuming 
task  during  this  study.  The  ECG,  EOG,  and  evoked  potentials  required 
separate  analysis  techniques.  Each  of  these  techniques  is  described  below. 

ECG  Analysis 

The  heart  rate  routine  calculated  the  time  between  R  waves,  or  inter-beat- 
intervals  (IBIs),  and  the  variance  of  the  IBls.  Prior  to  these  calcula¬ 
tions,  the  program  allowed  certain  parameters  to  be  manipulated  by  the 
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operator.  These  parameters  incladed  the  niniiiiuin  und  iiiaximuiii  IB  I  time 
values,  cardiac  (R  wave)  ampl i tu  le,  and  a  difference  criterion  in  terms  of 
sIo[)e  of  the  R  wave.  For  must  of  the  subjects  the  default  parameter  values 
provided  by  the  program  were  sufficient  for  the  correct  identification  of 
the  R  waves,  anci  the  resultant  IBis.  By  calling  a  file  name  within  the 
heart  rate  program,  the  first  10-second  block  of  heart  rate  data  was  dis¬ 
played  on  the  terminal.  Th(!  R  waves  on  the  screen  were  marked  with  an 
asterisk  by  the  program.  The  operator  visually  inspected  the  R  waves  and 
when  it  was  determined  that  the  program  was  identifying  them  correctly,  a 
"C"  was  entered  on  thi'  keyboard.  Then  the  prograii.  calculated  statistics 
for  the  entire  tile.  The  piograui  displayed  these  statistics  on  the  screen 
and  noted  any  "bad  bents"  (those  falling  outside  of  the  parameters)  for  the 
file.  In  most  cases,  adjusting  the  parameters  removed  the  bad  beats.  Yet 
a  problem  arose  when  h  waves  occurred  on  the  "edges"  (beginning  or  end)  of 
the  10-second  blocks.  These  R  waves  were  lost  to  the  analysis  and  intro¬ 
duced  artifactual  variance  to  the  IBl  averages.  Ihis  same  problem  was  out¬ 
lined  by  Albery  (1988).  (It  is  suggested  that  an  option  be  added  to  the 
heart  rate  program  that  allows  the  operator  to  insert  an  asterisk  at  the 
correct  R  wave  occurrence,  even  if  it  falls  at  the;  edge  of  a  10-second 
bl ock . ) 

The  NWTB  allowed  for  a  printout  of  the  summary  statistics  via  a  printer 
mounted  at  the  front  of  the  computer.  This  capability  ensured  that  the 
operator  obtained  hard  data  copies  of  each  file  summary.  However,  the  NWTB 
did  not  possess  the  capability  to  organize  multiple  heart  rate  files  into  a 
"master"  file  for  further  analysis.  The  summary  statistics  were  entered  by 
hand  onto  a  data  sheet,  and  ultimately  input  into  a  SAS  file.  (It  was 
recommended  that  this  labor  intensive  process  be  replaced  by  a  software 
module  that  will  organize  master  files.)  Recently,  developing  an  NWTB 
interface  for  file  transfer  to  other  computers  that  have  statistics  soft¬ 
ware  has  greatly  reduced  operator  time.  Unfortunately,  this  interface  was 
not  available  for  use  at  the  time  of  our  data  transfer. 

The  NWTB  summary  statistics  gave  the  averages  of  the  IB  Is  for  each  of  the 
10-second  blocks,  as  well  as  the  overall  segment  average.  When  it  was 
decided  post  hoc  to  break  the  overall  segment  averages  down  into  the  first 
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drul  last  30  seconds  of  the  segments,  the  Ilil  values  were  averaged  across 
th(?  first  three  and  last  three  10-second  blocks.  The  variability  of  the 
IB  is  could  not  be  averaged  by  blocks  nor  be  examined  in  the  same  manner  as 
the  IBls.  (A  small  proyraai  module  that  would  allow  different  combination 
averages  of  the  10-second  blocks  is  another  recommended  option  that  would 
have  reduced  operator  time  and  produced  a  more  detailed  analysis.) 

EOG  Analysis 

The  eyeblink  data  were  the  easiest  to  reduce  using  tl)e  NWTB.  The  feature 
that  expedited  the  analysis  was  that  of  a  moving  cursor  under  the  control 
of  the  operator.  The  parameters  that  identified  an  eyeblink  were  those  of 
blink  amplitude,  miminum  and  maximum  blink  time  and  slope  of  the  eye 
closure.  Usually  these  parameters  were  sufficient.  At  tiuies,  however, 
blinks  would  occur  that  did  not  fit  the  subjecl.'s  ovi-rall  olink  pattern. 
Changing  the  parameti'rs  to  include  or  exclude  <in  unusual  blink  often 
affected  more  "normal"  blinks.  The  cursor  option  eliminatc'd  this  problem 
by  allowing  the  operator  to  add  or  delete  a  blink  without  changing  parame¬ 
ter  values.  As  with  the  heart  rate  program,  when  the  operator  was  satis¬ 
fied  that  the  program  wa  .  identifying  blinks  correctly,  a  "C"  was  entered 
and  summary  statistics  ootained.  A  hard  copy  was  also  available  from  the 
NWTB  printer.  The  form  of  the  summary  statistics  was  different  in  that 
number  of  blinks,  inter  olink  interval,  closing  duration,  and  one-half 
amplitude  closing  duration  was  given  for  the  eyeblink  data. 

The  same  problems  occurred  during  the  eyet>link  analysis  as  those  found  with 
the  heart  rate  program,  specifically,  entering  data  by  hanJ  and  lack  of 
post  hoc  analysis  programs.  When  examining  the  first  and  last  30  seconds 
of  each  segment,  only  tfie  number  of  blinks  could  oe  averaged  across  the 
10-second  blocks. 

Otner  firoblems  emerged  during  tiie  eyeblink  analysis  not  found  with  heart 
rate.  In  some  instances,  subjects  did  not  blink  at  all.  The  operator  was 
confronted  with  zeros  across  all  summary  statistics,  and  was  required  to 
scroll  through  the  entire  data  file  visually  to  ensure  that  the  program  had 
not  missed  real  blink  occurrences,  furthermore,  two  or  more  blinks  had  to 


occur  within  a  10-second  block,  or  the  blink  variance  could  not  be  calcu¬ 
lated.  This  was  not  a  problem  unique  to  the  NWTB.  Missing  data  (no 
blinks,  or  less  than  two  blinks)  are  a  function  of  the  eyeblink  measure, 
and  were  treated  here  as  pertinent  data  during  later  analysis. 

Evoked  Potential  Analysis 

The  routine  on  the  NWTB  averaged  together  the  single  evoked  potentials 
elicited  by  the  tones.  The  program  produced  separate  averages  for  rare  and 
frequent  tones.  Furthermore,  the  program  automatically  placed  a  vertical 
line  at  the  place  on  the  evoked  potential  (EP)  averaged  waveform  that  was 
the  largest  in  amplitude.  The  NWTb  also  provided  an  operator  controlled 
cursor  that  allowed  amplitude  and  latency  measures  to  be  obtained  for  any 
of  the  components  of  the  averaged  EPs. 

The  two  most  time  consuming  tasks  in  removing  the  pertinent  data  from  the 
NWTB  were  those  of  "picking"  the  correct  components  of  each  waveform  by 
moving  the  cursor,  and  transferring  the  corresponding  amplitude  and  latency 
values  to  data  sheets  by  hand  (and  ultimately  to  another  computer  for  sta¬ 
tistical  analysis). 

Other  problems  were  encountered  that  were  unique  to  the  evoked  potential 
measures-  One  minute  of  EP  recording  during  the  flight  task  limited  the 
number  of  single  trials  available  for  each  average.  This  problem  was 
further  compounded  by  the  subjects'  tendency  to  blink  at  the  onset  of  each 
tone,  especially  the  rare  tones.  Without  an  eyeblink  correction  program  on 
the  NWTB,  the  operator  had  to  determine  the  minimum  eyeblink  amplitude 
threshold  for  each  EP  average,  without  going  below  a  12  single  trial  cut¬ 
off  for  each  average.  The  overall  eyeblink  amplitude  thresholds  for  the  EP 
averages  ranged  from  500  microvolts  to  two  and  one-half  millivolts. 
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Section  4 

EXPl.lUMLNiAl.  METHODS 


SUBJECTS 


Six  healthy  male  nonpilots,  aged  20-45  years,  participated  in  this  study. 
Each  subject  was  right-handed  and  had  approximately  20/20  uncorrected 
vision. 

DESIGN 

Data  were  collected  in  a  mixed  factorial  design.  Independent  measures 
included  training  session  (early,  middle  or  late  training,  test  session  1 
or  2),  visibility  (day  or  night),  and  flight  segment  (REST,  TO,  SLl,  BI, 
SL2,  (12,  SL3,  and  L).  The  visibility  factor  w.is  counterba I anced  within  and 
between  subjects.  Night  was  the  same  flight  scenario  as  day,  but  the  dis¬ 
play  became  dimmer  and  "night  lights"  from  the  city,  runway,  and  aircraft 
became  apparent.  Dependent  measures  included  root  mean  square  error,  which 
represented  distance  between  the  lead/wing  planes  in  the  three  axes  (XRMS, 
YRMS,  and  ZRMS),  heart  rate  and  heart  rate  variability  (HR  and  HRV),  eye- 
blinlc  rate,  duration,  half  amplitude  duration  and  variability  (BR,  DUR, 

HOUR  and  BV),  and  N200/P300  amplitude  and  latency  of  the  evoked  potentials 
obtained  from  the  EEC. 

PROCEDURES 

Training 

The  primary  task  required  the  subjects  to  follow  the  prerecorded  lead 
flightpath,  described  previously.  Training  was  composed  of  12  sessions 
which  lasted  for  1  hour  and  15  minutes  each.  On  the  first  day,  subjects 
were  introduced  to  the  task  and  given  the  opportunity  to  operate  the  simu¬ 
lated  F-15  aircraft.  On  the  second  day,  they  learned  how  to  fly  behind  the 
prerecorded  lead  aircraft  (see  Table  1  for  the  training  schedule). 

Following  these  2  days,  subjects  received  standardized  training  which  con¬ 
sisted  of  six  full  missions  and  four  "landing  only"  segments.  Following 
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FABLE  1.  TRAINING  SCHEDULE  SHEET 


Subject  _  Condition  Order  _  Date 

DAY  1: 

Fami 1 iarization: 

-  Experimental  Purpose  .ind  Task 

-  Introduction  to  the  NUTB 

Purpose 

Instrumentation 
Data  Collection 

-  Introduction  to  Flight  Program 

Flight  Path 
Flight  Procedures 
Briefing  Demo 

-  Sample  Physiological  Data 

-  Focused  “raining 

Overview  of  Controls 
FI aps  and  Spoi lers 
Demo  Flight 

-  Hands  On  Training 

Day  and  Night 
(D)  (N) 

-  Take-Off  Procedure  for  Lift  Off 

-  Straight  and  Li.'vel  Altitude  and  Jink 

-  Banking  I’rocedure  for  Turning 

-  Landing 

Approach 

Speed 

Rate  of  Descent 
Control s 
Touchdown 


DAY  2: 

Review: 

-  FI ight  Procedures 

-  Overview  of  Controls 

-  Flaps  and  Spoilers 

-  Day  and  Night  Flights 

-  Introduction  to  Top  Gun 

Formation  Flying 
Demo  of  Prerecorded  Flight 
Performance  Requirements 
Following  Lead 

-  Hands  On  Wing  Training  (same  as  DAY  1  Hands  On  Training) 
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the  second  (early),  seventh  (middle)  and  twelfth  (late)  training  sessions, 
all  the  dependent  measures  were  collected  except  the  EEG,  to  provide  infor¬ 
mation  on  training  progress.  On  these  data  collection  days,  a  2-minute  EOG 
and  ECG  baseline  measurement  was  taken,  followed  by  two  full  warm-up 
flights.  Following  warm-up,  two  full  missions  were  flown  where  EOG,  ECG 
and  RMS  error  scores  were  collected. 

Training  criterion  was  reached  when  subjects  could  maintain  a  distance  of 
1500  feet  maximum  between  his  own  plane  and  that  of  the  leal.  A  landing 
with  a  score  of  zero  (no  crash)  had  to  be  obtained  at  least  half  the 
time.  Of  six  subjects,  five  reached  criterion  by  the  last  training 
session.  These  five  subjects'  data  were  used  in  all  subsequent  analyses. 

Testing 

Data  were  also  collected  on  the  sixteenth  (test  1)  arid  the  seventeenth 
(test  2)  day.  Because  LEG  rlata  were  collected  during  thesri  sessions,  which 
resulted  in  longer  preparation  and  data  reduction  times,  each  session 
lasted  approximately  3  hours.  Similar  to  the  data  collection  for  training, 
two  minutes  of  EOG  and  ECG  baseline  data  were  collected  prior  to  flight. 
Also,  EEG  data  were  collected  during  the  second  minute  prior  to  flight 
while  the  subjects  monitored  audio  rare  events  (see  irelow).  Following 
baseline,  subjects  were  given  two  full  warm-up  flights,  and  then  required 
to  fly  two  full  missions  during  which  all  dependent  measures  were  col¬ 
lected.  The  audio  rare  ?vent  occurred  for  1  minute  during  each  segment  for 
both  test  1  and  2  lights. 

Audio  Rare  Event  (Oddbal!) 

The  secondary  task  was  the  Audio  Rare  Event,  or  Oddball  test,  which  was 
used  to  elicit  evoked  potentials  from  the  background  EEG.  This  standard 
test  was  taken  from  the  iiWTB .  The  Oddball  intermittently  presented  two 
tones  of  different  pitch  to  the  subject  via  headphones.  Ihe  subject's  task 
was  to  count  the  number  of  tones  occurring  in  i  specific  pitch  while 
ignoring  the  other  tone.  The  task  was  designed  to  present  the  counted  tone 
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between  20  to  4)  percent  ot  the  time.  Hence  the  tidine  "rdre"  and  "odd¬ 
ball."  The  parameters  for  this  test  are  presente  i  in  Table  2 


TABLE  2.  P/TRAMErEKS  FOR  IHL  AUUllORy  ODDBALL 


Rate  tone: 

1501  Hz 

Frecjuent  tone: 

1199  liz 

Interstimulus  interval: 

1500  liisec 

Probability  of  rare  tone: 

40  percent 

Minimum  nuisber  of  rare  tones: 

14 

Tone  inten>ity: 

1  (approx.  /5-HO  Db  (A) ) 

Test  wi 1 1 

last  60  seconds  * 

*  (machine  time  was  actually  longer) 

Electrode  Placei nent  and  Procedure 

Silver-silver  chloride  electrodes  were  used  for  data  collection.  Adhesive 
collars  were  placed  around  the  cuff  surrounding  the  electrode.  The  elec¬ 
trode  was  then  filled  with  conducting  cream.  The  subjects'  skin  was 
lightly  scrubbed  with  a  mild  abrasive  gel,  rinsed  with  alcohol,  and  dried 
with  a  gauze  pad.  Following  preparations,  one  electrode  was  placed  on  each 
of  the  subjects'  mastoids,  one  for  reference  and  one  for  ground.  For  EOG, 
an  electrode  was  placed  centrally  just  above  the  eyel)row  of  the  dominant 
eye.  For  ECG,  in  electrode  was  placed  one-half  inch  above  the  top  of  the 
sternum  (fleshy  midline  indentation),  with  a  reterenc;e  electrode  placed  on 
the  subject's  side,  just  below  the  lowest  left  rib.  Tor  the  LEG,  an  elec¬ 
trode  was  positioned  on  the  central  parietal  area  (P/)  according  to  the 
10-20  system  of  scalp  electrode  placement  (Jasper,  1958).  Impedances 
between  signal  and  reference  electrodes  were  kept  below  20K  ohms  for  ECG, 
below  lOK  ohms  for  EOG  and  below  5K  ohms  for  EEG.  The  mastoid  electrode 
with  the  lowest  impedance  v;as  used  to  reference  the  LOG  and  LEG;  the  other 
electrodf!  was  used  as  ground  for  all  three  signals.  Impedance  for  all 
connections  was  checked  periodically  throughout  the  riata  sessions. 
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Section  5 
RESULTS 

The  following  paired  comparisons  for  the  behavioral  data  were  performed 
using  standard  one-tailed  t-tests,  significant  at  p  <  0.05.  The  paired 
comparisons  for  the  physiological  data  were  performed  using  the  more  con¬ 
servative  Bonferroni  test,  also  significant  at  p  <  0.05.  The  analysis  of 
variances  (ANOVAs)  reported  here  were  obtained  through  the  1985  version  of 
SAS. 

BEHAVIORAL  DATA 

The  X  axis  data  reported  below  represents  the  amount  of  the  subjects' 
lateral  offset  compared  to  the  wing  position.  The  Y  axis  data  corresponds 
to  the  altitude  difference  between  the  subject  and  lead.  Finally,  the  Z 
axis  corresponds  to  the  trail  distance  of  the  subject  to  the  lead. 

X  Axis  (Lateral  Offset) 

RMSX.  The  root  mean  square  error  in  the  X  axis  (RMSX)  was  affected  by 
flight  segment,  F(6,24)  =  15.32,  p  <  0.0001.  As  can  be  seen  in  Figure  3, 
RMSX  was  larger  during  the  two  bank  segments  than  during  the  rest  of  the 
flight.  Day/night  conditions  and  session  block  mediated  this  effect.  The 
segment  by  day/night  interaction  was  significant,  F(6,24)  =  3.34, 
p  <  0.0154.  This  interaction  is  depicted  in  Figure  4.  During  the  first 
bank  segment,  RMSX  was  larger  during  the  day  condition  than  during  night. 
The  segment  by  session  block  interaction  was  also  significant,  F(24,9)  = 
3.44,  p  <  0.0001.  As  can  be  seen  in  Figure  5,  during  the  first  and  second 
bank  segments  and  second  straight  and  level  the  RMSX  was  larger  early  in 
the  session  blocks. 

Y  Axis  (Altitude) 


RMSY.  The  only  significant  effect  for  RMSY  was  that  of  session  block, 
F(4,16)  =  3.54,  p  <  0.0298.  This  effect  is  shown  in  Figure  6.  RMSY  was 
larger  during  the  early  session  block  than  during  the  rest  of  the  sessions. 
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SEGMENT  F(6,24)  =  15.32,  p  <  .0001 


SIMULATED  FLIGHT  SEGMENT 


SEGMENT  ‘D/N  F(6,24)  =  3.34,  p  <  0154 
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Figure  5.  RMSX  Lateral  Offset  Segment  by  Session  Block  Effects 


BLOCK  F(4,16)  =  3.54,  p  <  .0298 


SESSION  BLOCK 


Z  Axis  (Trailing  Distance) 


RMSZ.  There  was  a  significant  effect  of  segment  on  RTISZ,  F(6,24)  =  3.11, 
p  <  0.0213.  Rf'iSZ  was  larger  during  the  second  and  third  straight  and  level 
and  the  second  bank  than  during  the  other  flight  segments  (Figure  7). 
Similar  to  the  X  axis,  this  segment  effect  was  mediated  by  day/night  condi¬ 
tions  and  session  block.  The  segment  by  day/night  interaction  was  signifi¬ 
cant,  F(6,24)  =  2.65,  p  <  0.0410.  As  depicted  in  Figure  8,  RMSZ  was  larger 
at  the  second  straight  and  level  segment  during  day  than  during  night.  The 
segment  by  session  block  interaction  was  significant,  F(24,96)  =  2.27, 
p  <  0.0026.  Figure  9  shows  that  RMSZ  was  larger  at  the  second  and  third 
straight  and  level,  the  second  bank,  and  landing  segments  during  day  flight 
than  during  night. 

PHYSIOLOGICAL  DATA 

Heart  Rate  (ECG) 

Beats  Per  Minute  (8PM).  The  first  test  performed  on  the  heart  rate  in  BPM 
was  a  flight  segment  by  session  block  interaction  ANOVA  (8  x  5).  This 
interaction  was  not  significant.  The  main  effect  of  segment  was  signifi¬ 
cant,  F(7,28)  =  3.97,  p  <  0.0039.  As  shown  in  Figure  10,  during  the 
landing  segment  subject's  heart  rate  was  larger  than  during  rest,  take-off, 
the  first  straight  and  level  and  bank,  and  the  second  straight  and  level. 
The  second  bank  and  third  straight  and  level  were  not  significantly  differ¬ 
ent  from  landing.  The  main  effects  of  session  block  and  day/night  were  not 
significant. 

Another  test  of  heart  rate  was  performed  on  BPM  taken  from  the  first  and 
last  30  seconds  of  each  segment.  This  flight  segment  by  time  block 
analysis  of  variance  (ANOVA)  interaction  was  not  significant,  even  though 
visual  inspection  of  Figure  11  suggests  that  BPM  is  larger  during  the  last 
30  seconds  of  the  landing  than  during  the  first  30  seconds. 

Even  though  the  main  effect  of  session  block  was  not  significant,  a  pattern 
of  the  five  subjects'  means  emerged  along  training  order.  A  regression  was 


26 


SEGMENT  F(6,24)  =  3.11,  p  <  .0213 
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SIMUUMED  FLIGHT  SEGMENT 


S[£GMENT‘D/N  F(6,24)  =  2,65,  p  <.0410 


RMSZ  Trail  Distance  Segment  by  Visibility  Effects 
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performed  on  the  means,  as  shown  in  Figure  12.  The  r  value  equaled  0.7743, 
yet  accounted  for  only  59.9  percent  of  the  variance.  Again,  a  pattern  is 
apparent  upon  inspection,  but  not  statistically  significant. 

ilearL  Rdte  Variability  (IIRV).  The  first  test  performed  on  the  HRV  was  also 
a  flight  segment  by  session  block  ANOVA,  which  was  not  significant.  All 
main  effects,  day/night,  flight  segment  and  session  block,  were  not  sig¬ 
nificant.  However,  HRV  in  relation  to  flight  segment  is  presented  in  Fig¬ 
ure  13.  Recall  the  behavioral  data  in  the  X  axis  (lateral  offset)  during 
the  bank  segments  (Figures  4,  5  and  6).  The  HRV  appears  to  decrease  as 
RMSX  error  increases  during  bank  maneuvers. 

Eyeblink  (EOG) 

Number  of  Blinks.  The  first  test  performed  on  the  number  of  blinks  was  the 
flight  segment  by  session  block  interaction  ANOVA,  which  was  not  signifi¬ 
cant.  The  main  effects  of  session  block  and  day/night  were  also  not  sig¬ 
nificant.  Flight  segment  was  significant,  F(7,28)  =  11.55,  p  <  0.0001.  As 
shown  in  Figure  14,  subjects  blinked  more  during  take-off  than  during  any 
of  the  other  flight  segments. 

Another  test  was  performed  on  the  eyeblink  data,  similar  to  the  heart 
rate.  The  first  and  last  30  seconds  of  data  in  each  segment  were 
obtained.  The  flight  segment  by  time  block  (8  X  2)  interaction  was  sig¬ 
nificant,  F(7,28)  =  17.46,  p  <  0.0001.  As  can  be  seen  in  Figure  15,  sub¬ 
jects  blinked  more  during  the  first  30  seconds  of  the  take-off  segment  than 
during  the  last  30  seconds. 

Blink  Interval.  None  of  the  dependent  variables  affected  blink  interval, 
except  for  flight  segment.  The  main  effect  of  segment  was  significant, 
F(7,28)  =  2.68,  p  <  0.0297.  Blink  interval  was  larger  during  the  resting 
segment  than  during  all  other  segments. 

Hal f-Ampl i tude  Closing  Duration.  There  were  no  significant  interactions  or 
main  effects  for  this  eyeblink  measure. 
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SESSION  BLOCK 

Figure  12,  Beats  Per  Minute  Regressed  with  Session  Block 
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7,28)  =  17.46,  p  <  0.0001 


Closing  Duration.  The  interaction  for  flight  segment  by  session  block  was 
not  significant.  However,  all  three  main  effects  were  significant:  day/ 
night,  F(l,4)  =  11.18,  p  <  0.0287;  session  block,  F(4,14)  =  5.04, 
p  <  0.0100;  and  flight  segment,  F(7,28)  =  3.44,  p  <  0.0087.  As  can  be  seen 
in  Figure  16,  closing  duration  was  longer  during  day  than  during  night 
flights.  Also,  closing  duration  was  longer  during  both  test  conditions 
than  during  early,  middle  or  late  session  blocks  (see  Figure  17).  Closing 
duration  was  longer  during  the  resting  segment  than  during  all  other  flight 
segments,  as  shown  in  Figure  18. 

Evoked  Potentials 


The  data  reported  below  were  taken  from  both  the  rare  tone  and  frequent 
tone  evoked  potentials  obtained  from  the  oddball  task.  Components  were 
selected  according  to  latency  and  waveform  criterion.  For  the  identifica¬ 
tion  of  the  P200  component,  a  positive-going  deflection  had  to  occur  within 
a  150-300  msec  time  window  after  onset  of  the  stimulus.  For  the  N200  com¬ 
ponent,  a  negative-going  deflection  had  to  occur  within  150-350  msec.  For 
the  P300,  a  positive-going  component  had  to  occur  within  300-700  msec.  In 
many  instances  there  were  missing  components  in  the  individual  subjects' 
waveforms.  For  example,  the  frequent  tone  does  not  elicit  a  N200  or  P300 
for  most  subjects.  The  analysis  for  these  components  was  not  included 
since  over  half  of  the  data  points  were  missing.  For  the  rare  tone  evoked 
potentials  there  were  also  missing  data  points.  However,  all  components 
were  included  in  the  analysis  since  the  amount  of  missing  points  was  negli¬ 
gible.  Representative  subject  rare  tone  EPs,  as  plotted  by  the  NWTB,  are 
presented  in  Figure  19.  The  P300  components  on  both  averages  are  marked 
by  the  cursor.  The  latency  and  amplitude  values  of  the  P300  are  given  at 
the  bottom  of  each  waveform. 

Rare  Tone  Evoked  Potentials 


The  P200,  N200  and  P300  amplitude  and  latency  values  were  all  tested  for 
significance  in  relation  to  day/night,  flight  segment  and  test  block  (see 
Table  3).  The  only  component  to  show  significance  was  the  P200.  P200 

amplitude  varied  according  to  flight  segment,  F(7,28)  =  4.03,  p  <  0.0336. 
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Figure  17.  Blink  Duration  Session  Bio 


F(7,28)  =  3.44,  p  <  0.0087 


Figure  18. 


VOi  TS 


-  CURSOR  VALUES  - 


AMPLITUDE:  6.47  MICRO  VOLTS 
LATENCY;  5  25 


AMPLITUDE:  5.70  MICRO  VOLTS 
LATENCY:  52  0 


Figure  19.  Representative  Evoked  Potentials  from  Subjects  03  and  05 


TABLE  3.  SIGNIFICANT  TABLE  FOR  ALL  EP  COMPONENTS  (P  VALUE) 


P200 

Ampl itude 

P200 

Latency 

N200 

Ampl itude 

N200 

Latency 

P300 

Ampl i tude 

P300 

Latency 

RARE  TONE  COMPONENTS 

Day/Ni ght 

0.2058 

0.9116 

0.6989 

0.7351 

0.9502 

0.4476 

Segment 

0.0036* 

0.4529 

0.6463 

0.9698 

0.1138 

0.9630 

Traini ng 

Block 

0.9858 

0.1705 

0.9222 

0.4496 

0.5112 

0.3885 

Day/Ni ght 

X  Segment 

0.3804 

0.1302 

0.7005 

0.1613 

0.2955 

0.3893 

FREQUENT  TONE 

COMPONENTS 

Day/Night 

0.0550 

0.5259 

Segment 

0.0002* 

0.3573 

Training 

Block 

0.4101 

0.9891 

Day/Night 

X  Segment 

0.7877 

0.3254 

Amplitude  =  millivolts 
Latency  =  milliseconds 
*  p  <  0.05 


Amplitude  was  larger  during  rest  than  during  take-off,  the  first  and  second 
straight  and  level,  and  the  first  bank,  which  in  turn  were  larger  than  the 
second  bank,  the  third  straight  and  level,  and  landing  (see  Figure  20). 

Frequent  Tone  Evoked  Potentials 

The  P200  amplitude  of  the  frequent  tone  evoked  potential  also  varied 
according  to  flight  segment,  F(7,28)  =  6.33,  p  <  0.0002.  As  can  be  seen 

in  Figure  21,  amplitude  was  larger  during  rest  and  take-off  than  during  all 
other  segments  of  the  flight.  Day/night  and  test  block  effects  were  not 
significant. 
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SIMULATED  FLIGHT  SEGMENT 


Section  6 
DISCUSSION 


The  SO  behavioral  data  showed  clear  session  block  effects  in  all  three  con¬ 
trol  axes.  Subjects'  error  in  controlliny  their  aircraft  and  following  the 
lead  plane  was  larger  at  the  beginning  of  the  sessions.  Also,  heart  rate 
decreased  as  familiarity  and  competence  on  this  flight  task  increased.  The 
convergence  of  the  behavioral  error  and  heart  rate  data  suggests  a  definite 
training  effect  during  these  sessions. 

There  was  an  effect  attributed  to  day/night  visibility  which  was  surprising 
in  its  direction.  Error  in  the  lateral  offset  and  trail  distance  axes 
increased  during  day  flight  over  that  found  with  night  flight.  Subjects' 
comments  as  to  the  difficulty  of  the  flights  under  these  visibility  condi¬ 
tions  matched  the  increase  in  error  during  the  day  flight.  Most  subjects 
said  that  the  extraneous  display  information  during  day  flight  interferred 
with  the  task  of  following  the  lead  plane.  Night  flight  removed  this 
visual  information,  and  added  more  "relevant"  display  cues  such  as  lead 
tail/wing  lights  and  engine  burn  as  well  as  landing  lights  on  the  runway. 
Subjects  also  reported  improved  depth  cues  during  night  flight.  This  visi¬ 
bility  factor  also  affected  blink  behavior  in  the  manner  suggested  by 
Morris  ((1985)  see  Appendix).  The  length  of  time  the  eye  remained  closed 
(blink  duration)  was  longer  when  control  error  was  greatest,  i.e.,  during 
day  flight. 

It  should  be  noted  here  that  the  flight  simulation  w<is  a  low  fidelity  simu¬ 
lation  with  unrealistic  terrain  and  horizon  cut?s.  In  light  of  this  situa¬ 
tion,  it  might  not  be  too  surprising  to  find  converging  behavioral  and 
physiological  data  that  suggests  night  flight  was  easier  than  day  flight. 
These  patterns  would  not  be  expected  in  a  high  fidelity  simulation  or  real 
fl i ght. 

The  effects  of  the  different  flight  segments  on  control  error  were  differ¬ 
ent  for  lateral  offset  and  trail  distance.  The  lateral  offset  error 
between  the  subject's  plane  and  the  lead  was  greatest  during  both  the  first 
and  second  bank  maneuvers.  Furthermore,  both  IIRV  and  number  of  blinks 
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decreased  during  these  two  bank  segments.  Recall  that  increased  load  on  an 
operator  decreases  HRV  and  number  of  blinks.  The  corresponding  changes  in 
these  three  measures  (offset  error,  HRV,  and  blinks)  strongly  suggest  that 
the  first  and  second  bank  maneuvers  were  the  most  behaviorally  difficult 
segments  in  the  flight. 

Trail  distance  t-rror,  however,  was  most  affected  only  by  the  first  bank 
maneuver.  The  data  suggests  that  subjects  were  playing  "catch-up"  in  trail 
distance  to  the  lead  from  the  first  bank  up  until  landing  (see  Figure  6). 

An  interesting  aside  is  that,  had  only  tho  error  data  in  the  three  axis 
pursuit  tracking  task  been  obtained,  it  would  be  very  difficult  to  say 
where  in  the  fiight  tlie  greatest  control  demand  was  imposed  on  the  sub¬ 
jects.  The  altitude  axis  showed  no  segment  effeds,  and  the  offset  and 
trail  axes  show  two  distinctly  different  patterns  of  error.  Without  the 
physiological  data,  it  would  have  been  a  toss-up  between  the  offset  and 
trail  patterns  in  determining  the  segments  with  the  greatest  control  load. 

The  evoked  potential  data  were  disappointing.  The  P300  components  did  not 
covary  with  any  of  the  independent  variables  (segment,  session  or  visibil¬ 
ity).  The  rare  and  frequent  tone  P200  components  did  show  differences 
between  preflight  baseline  and  all  other  segments  of  the  flight.  A 
decreasing  rare  tone  P200  amplitude  trend  from  the  second  straight  and 
level  to  the  landing  segment,  was  also  apparent,  albeit  insignificant. 

Other  physiological  results  identified  flight  effects  not  found  with  the 
evoked  potential  or  behavioral  data.  Heart  rate  in  BPS  showed  increases 
during  the  landing  segment,  specifically  during  the  last  30  seconds  where 
subjects  were  actually  touching  down  on  the  runway.  At  least  during  the 
last  few  sessions,  if  the  siibjects  were  going  to  lose  control  of  their 
aircraft  and  possibly  crash,  it  would  have  been  during  tliis  segment.  The 
heart  rate  data  reflect  the  heightened  arousal  during  landing  that  the 
other  measures  do  not. 

The  eyeblink  data  showed  that  number  of  blinks  were  greatest  during  take¬ 
off,  specifically  during  the  first  30  seconds  of  the  segment  where  subjects 
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were  heavily  scanniny  tlie  cockpit  instrumentation  displays.  This  portion 
of  the  segment  was  spent  readying  the  airplane  tor  take-off  (e.g.  pretake¬ 
off  checks,  such  as  wing  flap  position)  prior  to  the  lead  fly-by.  The  last 
30  seconds  of  the  sinjiiient  were  actual  take-off  after  the  lead  fly-by  and 
during  this  portion  the  number  of  blinks  is  tfie  same  as  tiie  rest  of  the 
segments . 

In  summary,  the  physiological  data  provided  information  about  the  simulated 
flight  task  that  not  only  corresponded  to  and  further  clarified  the  behav¬ 
ioral  data,  but  also  showed  differences  between  seyiiien''S  of  tne  flight  task 
that  would  not  have  been  apparent  with  the  behavioral  data  alone. 
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Section  7 
RECa^MENDATIONS 


The  three  objectives  outlined  in  Section  of  this  document  included  a  test 
of  the  interface  between  the*  simulator  and  the  NWTB,  determining  the  value 
of  the  physiological  data  collected  dnd  formulating  recommendations  for 
further  use  of  these  measur.js  in  a  larger  simulation  effort. 

As  shown  elsewhere  in  this  report,  the  problems  o  interfacing  the  simula¬ 
tor  and  NWTB  were  time  consuming,  complicated  and  difficult  to  solve.  Yet 
there  is  now  in  place  the  capability  to  record  physiological  data  in  con¬ 
junction  with  SABER  simulator  events.  Tht^  interface  problems  have  been 
solved  during  this  preliminary  effort.  However,  as  discussed  in  Section  3, 
the  NWTB  still  possesses  user-intensive  rfiqui remeuts  Tor  obtaining  data 
means  and  summary  statistics.  Without  a  .ubstantial  investment  in  software 
changes  these  requirements  will  remain.  It  now  bi.-comes  a  question  of  a 
trade-off  betwei n  the  cost  if  employing  an  NWTB  operator,  the  intrinsic 
worth  of  the  data  obtained,  and  delays  in  obtaining  reduced/analyzed  data. 

From  the  data  reported  above,  physiological  results  not  only  clarified 
behavioral  issues,  but  also  provided  additional  information  not  obtained 
otherwise.  This  simulation  was  a  low  fidiility,  "video  game"  flight  task, 
and  yet  the  heart  rate  and  lyeblink  measures  were  sensitive  to  flight 
changes.  With  the  exceptic-  of  the  evoked  potential  oddball  task,  these 
physiological  measures  added  a  wealth  of  information  to  the  evaluative  data 
base.  It  would  be  expected  that  with  a  more  realistic  simulation  these 
measures  would  add  the  same,  if  not  more,  dimensionality  and  precision  to 
any  flight  evaluation. 

As  to  the  failure  of  the  evoked  potential  technique,  there  are  two  possible 
methodological  changes  that  could  be  implemented  in  the  future  to  increase 
measurement  sensitivity.  The  first  would  be  to  attain  an  eyeblink  correc¬ 
tion  program  to  ensure  a  larger  number  of  single  trials  in  each  of  the  sub¬ 
jects'  averages.  The  other  would  be  to  cliange  tiie  evoking  stimulus  from  a 
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secondary  oddball  paradiyin  to  a  relevant  fMyht  task.  Any  flight  event 
that  is  repeated  throuyhout  the  course  of  the  iliyht  mission  could  be  used 
to  time-lock  and  average  the  EEG. 

An  important  (|uestion  for  the  future  use  of  the  SABEI^  simulators  would  be 
that  of  practice  and  transfer  of  learning.  The  physiological  measure  most 
amenable  to  this  has  been  heart  rate  (as  reported  in  the  literature  and  as 
evidenced  above).  The  subjects  used  in  this  study  were  not  experienced 
pilots.  Pilots  with  experience  would  be  expected  to  give  substantially 
different  response  profiles,  not  only  behavioral ly  but  physiologically.  It 
is  highly  recommended  that  any  SABER  investigation  of  experts  versus 
novices,  as  well  as  responses  obtained  from  simulation  versus  actual 
flight,  include  physiological  measures. 

Other  recommendations  for  a  laryirr,  high-fidelity  simulation  would  be: 

1.  A  priori  identification  of  the  flight  task  segments  of  interest, 
and  timing  of  these  segments  to  the  nearest  second  (requires  the 
simulation  be  in  place  with  existing  time-line  analyses). 

2.  Allow  for  the  marking  of  the  simulator's  and  NWTB's  time  history 
for  such  things  as  pre-programmed  emi-ryencies  and  unplanned 
crashes,  etc. 

3.  Obtain  an  operitor  trained  on  the  NWTB  and  simulator  parameters 
before  data  collection,  as  v/ell  as  a  consultant  for  the  design  of 
physiological  methodology. 

Overall,  it  is  recommend(!d  that  i)hysiological  response  measures  be  obtained 
during  any  simulator  mis. ion.  In  part-task  through  whole  mission  scenarios 
these  measures  can  only  add  to  tiie  understanding  of  the  crewmember's  role 
during  flight. 
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Section  y 
CONCLUSlONb 


The  SABEK  facility  has  been  established  to  investigate  the  issues  involved 
in  developing  a  Ivanced  crew  sysiems.  The  development  of  these  new  systems 
will  undoubtedly  open  up  new  dimensions  of  infurination  transactions  at  the 
point  of  crewmember  control  and  systems  displays.  The  ultimate  goals  of 
the  SABER  facility  include  maximizing  the  effectiveness  of  the  crewmember 
within  the  system,  while  minimizing  the  number  of  crt'wiiieinbers  needed  for 
the  successful  performance  of  a  mission. 

The  SABER  facility  is  particularly  suited  for  the  investigation  of  evolving 
and  new  strategic  missions.  The  technologies  needed  for  the  successful 
accomplishment  of  these  missions  will  be  a  significant  driving  factor  con¬ 
cerning  crewmember  interface  design,  especially  in  such  areas  as  tfie  offen¬ 
sive  weapons  crs'wstat i on.  The  introduction  of  technologies  new  to  the 
crewstations ,  s  ich  as  complex  artificial  intelligence  modules,  will  provide 
quantities  of  unknown  and  indeterminate  information  to  the  crewmember.  It 
will  become  increasingly  important,  and  increasingly  difficult  to  investi¬ 
gate  crewmember  workload  and  situational  awareness. 

The  SABER  facility  is  employing  a  three-pronged  approach  in  documenting 
both  crew  workload  and  situational  awareness.  Ihe  first  is  the  collection 
of  relevant  tiimj  based  behavioral  data  during  real-time  simulated  missions, 
utilizing  the  four-member  SABER  crewstation.  Data  such  as  tligfit  control 
parameters,  weapons  delivery  timing  and  accuracy,  and  the  timely  response 
to  task  relevant  information  are  currently  available  to  provide  an  objec¬ 
tive  data  base. 

The  second  is  the  collection  of  each  crewmember's  ratings  of  the  difficulty 
of  the  mission  segments.  Data  can  be  collected  during  relevant  points  of 
the  mission  simulation  by  using  such  techniques  as  the  Subjective  Workload 
Assessment  Technique  (SWAT)  via  the  simulator's  intercom  system.  Subse¬ 
quent  debriefing  of  the  crewmembers  using  recall  probes  augmented  with 
behavioral  data  can  add  to  the  subjective  data  base. 
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The  third  technique  will  be  a  class  of  physiological  measures  utilizing  the 
NWTB .  The  NWTB  is  a  computer  based  collection  tool  that  lias  undergone 
specific  modifications  for  SABtk  requirements.  The  modifications  include 
expansions  to  memory  that  allow  data  collection  from  two  crewmembers 
simultaneously  for  up  to  0  hours  in  duration.  Interfaces  that  allow  for 
the  mutual  time  synchronization  of  the  NWTB  and  SABLR  weri*  developed  which, 
in  turn,  allow  for  the  correlation  of  physiological,  behavioral,  and  sub¬ 
jective  data  bases.  The  collection  of  physiological  data  during  a  simu¬ 
lated  flight  mission  was  shown  to  be  a  successful  and  useful  technique  for 
the  investigation  of  cri.-wmember  workload. 

Utilizing  this  three-pronged  approach  of  behavioral,  subjective,  and 
physiological  measures  should  provide  a  multidimensional  nicture  of  work¬ 
load  and  situational  awareness.  Mow  that  the  SABER  facility  possesses  the 
capability  of  collecting  all  three  measures,  it  is  expected  that  the  inves¬ 
tigations  of  crewniember/crewstation  interactions  will  be  .1  truer  represen¬ 
tation  of  the  actual  mission  re(|ui reinents  involved. 
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API’LIMDI  ( 


In  1987,  dn  AGA’-Doyraijh  (edited  by  Stan  Rnscoe)  v^as  devoted  entirely  to 
outlinincj  the  s'.ate-of-the-art  techniques  used  to  identify  and  quantify  the 
characteristics  of  any  given  flight  syste'n  (AGAKL)  Uo.  282,  1987).  In  11  of 
the  16  ciiapters  dealing  with  v/oikload  and  huinan-machi ne  interactions,  psy¬ 
chophysiol  ogi  ca ;  techniques  were  utilized. 

The  multidimensional  qualities  of  workload  have  recently  been  recognized, 
as  evident  in  the  continuing  interest  of  using  a  three-pronged  approach  to 
investigate  human-machi ne  interactions.  This  approach  consists  of  using 
objective,  subjective  and  physiological  techniques. 

Most  investigations  of  new  or  existing  crew  stations,  cockpits  and  assembly 
lines  use  the  oiijective  category  of  techniques.  This  category  includes 
detailed  time-line  analyses  of  task  demands,  time  and  motion  studies,  and 
performance  measures  (including  secondary  task  techniques).  Furthermore, 
the  use  of  subjective  techniques,  such  as  rating  scales  obtained  from 
operators  during  performance,  have  proven  reliable  as  indicators  of  the 
level  of  perceived  workload. 

Psychophysiological  technic|ues  <ire  relatively  new  in  tlie  applications  field 
and  so  do  not  benefit  from  repeated  use  as  do  the  more  routinely  used 
methods  of  objective  and  subjective  techniques.  However,  there  exists  a 
wide  body  of  laboratory  data  that  supports  the  idea  that  much  can  be  gained 
from  these  physiological  techniques,  as  well  as  the  few  reports  that  deal 
with  data  obtained  from  simulations  and  actual  in-flight  operational  mis¬ 
sions.  Psychophysiological  techniques  can  fill  in  the  informational  gaps 
left  by  objective  and  subjective  techniques.  Time-line  analyses  yield 
information  only  about  the  task,  and  performance  measures  give  information 
only  about  human-machine  status  at  that  given  time.  It  does  not  answer 
questions  about  predictive  performance  under  stress,  such  as  emergencies 
and  bottlenecks  in  human  capacity  (U'Oonnell  and  tggemeier,  1986).  Sub¬ 
jective  techniques  may  answer  some  of  these  questions,  yet  it  has  been 
pointed  out  before  that  these  techniques  have  their  own  unique  short¬ 
comings,  including  individual  biases,  poor  individual  replication  under 
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similar  circumstances,  and  delayed  ratings  undi.'r  higii  workload  conditions 
(Hart,  1982).  Psychophysiol ogical  techni(|ues  have  been  used  precisely  to 
fill  in  these  informational  gaps.  It  is  recommended  that  this  three¬ 
pronged  approach  (objective,  subjective,  and  pliysiolegical )  be  used  to 
ol)tdin  a  more  cumpl(,‘te  pictiire  ul  huiiian-iriachine  i nteract ions . 

PSYCHOPflYSIOLOGY  IN  RELATION  TO  FLIGHT  PARAMETERS 

Heart  Rate  (or  EGG) 

As  early  as  1967,  researchers  were  examining  changes  in  the  cardio-vascular 
system  of  pilots  during  different  flight  segments.  Smith  (1967)  reported 
elevations  of  heart  rate  during  take-off  and  landing  phases  of  commercial 
airline  routes.  Roman,  Older  and  Jones  (1967)  reported  that  navy  pilots 
flying  combat  missions  had  higher  heart  rates  during  carrier  landing  than 
during  actual  target  acquisition  and  weapons  delivery.  This  finding 
opposed  the  belief  tliat  icquisition  and  ddivei’y  was  the  most  taxing  and 
dangerous  flight  segment. 

Increased  heart  rate  during  take-off  and  landing  segments  of  any  given 
commercial  flight  is  not  surprising  since  fliglit  time  between  these  two 
segments  does  not  usual!/  entail  a  large  <imounl  of  pilot  activity.  How¬ 
ever,  in  the  above  military  scenario,  the  segments  between  take-off  and 
landing  required  at  least  the  same  amount,  if  not  greater,  pilot  activity 
and  attention  to  flight  parameters  as  during  take-off  and  landing.  This 
psychophysiological  technique  revealed  information  not  obtainable  with  the 
more  traditional  measures. 

The  usefulness  of  psychophysiological  measures  was  also  demonstrated  in  a 
recent  application  of  heirt  rate  measures  during  the  performance  of  an  A-7D 
mission  scenario.  Skell/,  Purvis  and  Wilson  (1987)  and  Wilson,  Purvis, 
Skelly,  Fullenkamp,  and  Javis  (1987)  reported  lata  taken  i rom  pilots  during 
the  training  performance  of  a  tactical  mission  in  both  actual  and  simulated 
flight.  Heart  rate  was  sensitive  to  changes  in  mission  segments  as  well  as 
in-flight  versus  simulator  differences.  Specifically,  mission  events 
affected  heart  rate  in  the  lead  and  wing  liut  n Jt  in  the  simulator.  For  the 


lead  flights,  pilots'  heart  rate  was  higher  during  pretake-off,  take-off, 
guns  jink,  90-dejree  slice  naneuver,  weapons  delivery,  and  landing  than 
during  briefing,  fly-over  uidate,  and  cruise.  For  tne  wing,  pilots'  heart 
rate  was  liigher  during  these  same  segments  than  for  briefing  and  cruise. 
Pilots'  heart  rates  during  simulator  flight  did  ncit  sliow  these  differ¬ 
ences.  Furthermore,  heart  rate  was  higher  overall  during  the  lead  flight 
than  during  the  wing  flight,  and  higher  during  winy  than  during  simulator 
flight.  Wilson  et  al.  (198/)  suggested  that  the  added  workload  of  piloting 
an  actual  aircraft  over  that  of  a  simulator,  and  the  increased  duties/ 
responsibilities  of  the  lead  pilot,  led  to  these  increases  in  heart  rate. 

These  results  lend  sufiport  to  the  assumption  that  simulations  of  flight 
missions  will  not  elicit  the  same  physiological  responses  from  pilots  that 
are  found  during  actual  flight.  This  has  direct  liearing  on  heart  rate 
taken  during  simulator  fligiit.  As  discussed  in  Skelly  et  al.  (1987),  there 
is  a  need  to  measure  physiological  reactivity  in  simulators  to  examine  how 
and  where  simulator  fidelity  affects  crew  performance.  It  iiiay  be  that  the 
mer(>  physical  similarity  between  simulators  and  aircraft  is  not  sufficient 
to  iiave  true  applicability  in  training,  licensing  and  certification,  and 
general  engineering  researcii.  In  the  SABFR  laboratories,  however,  heart 
rate  responses  obtained  from  simulation  can  be  used  as  baselines  in  rela¬ 
tion  to  actual  aircraft  flight.  Furthermore,  heart  rate  can  be  applied  as 
a  measure  of  "relational"  fidelity.  As  an  example,  two  separate  weapons 
delivery  simulations  may  elicit  different  increases  in  heart  rate. 

Related  results  obtained  in  the  laboratory  suggest  further  uses  of  heart 
rate  in  examining  training  effects.  In  1973,  /.waga  asserted  that  heart 
rate  reactivity  was  directly  related  to  the  amount  of  time  any  given  sub¬ 
ject  had  practiced  on  a  task.  The  main  hypothesis  was  that  the  initial 
introduction  to  a  task  precipitated  increased  heart  rate,  and  that  further 
performance  of  that  task  would  see  gradually  decreasing  heart  rate.  These 
effects  occur  even  when  behavioral  performance  is  stable  from  the  beginning 
to  the  end  of  the  task  (McCloskey,  1987).  This  has  importance  when 
training  and  task  load  effects  occur  in  a  situation  at  the  same  time.  In 
other  words,  task  load  effects  may  be  superimposed  over  a  gradually 
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docreds  I  ny  trend  in  IumpL  rdte,  and  Lin's  trend  may  even  ub'sture  the  task 
load  effects. 

tyebl i nk  (or  LdG) 

Eyeblink  behavior  dnriny  demandiny  tasks  lias  fjeen  ciiaracLi.Ti  zed  as  follows: 

•  As  attentional  demands  Increase,  the  number  of  Idinks  decreases. 

«  As  attentional  demands  increase,  the  length  of  time  the  eye  is 

closed  decreases. 

•  As  tatiyue  iidreases,  number  of  blinks  and  dura'. ion  of  blinks 
i ncreases. 

These  phenomena  have  lieen  fieavi  fy  documented  in  Ltie  liter  iture  (dauer, 
Strock,  Goldstein,  'jLern,  and  Walrath,  19d4;  Stiirn  and  Sk.-lly,  1984;  btern, 
Walrath,  and  Goldstein,  1984).  Stern,  Walrath,  and  Golds. ein  (1984) 
reviewed  the  evidence  concerning  eyeblink  behavior  during  task  perform¬ 
ance.  It  is  postulated  that  blinking  is  oest  understood  :n  terms  of  a 
cognitively-based  mechanism  whicli  suppresses  l>link  fiehavior  until  such 
times  as  decisions  alioui.  external  stimuli  have  been  made. 

Stern  and  Skelly  (1984)  reported  data  that  were  obtained  during  high- 
fidelity  simulator  missons.  blink  rate  discriminated  between  the  pilot  in 
control  of  the  aircraft  and  the  person  acting  as  copilot.  Furthermore, 
mission  segments  affected  lilink  rate.  During  the  weapons  delivery  and 
"coping  with  threat"  seciaents,  lilink  rate  decreased.  The  .e  mission  segment 
effects  on  blink  rate  are  eviderice  that  blink  rate  i  an  be  a  laeasure  of  task 
demands  in  an  aircraft  setting.  Also,  blink  duration  increased  from  pilot 
to  copilot,  and  was  shown  to  imreasi?  in  latency  as  time-on-task  increased. 

Another  interesting  aspect  of  blink  beliaviur  is  evitience  .hat  high  rates  of 
long-duration  blinks  fluring  the  "taking-in"  and  proiessinj  of  relevant 
stimuli  may  be  an  indication  of  erroneous  performani.e  (mi  .sed  signals, 
incorrect  responses,  etc.).  Morris  (198‘j)  used  a  basic  instrument  flight 


trainer  with  cockpit  motion  and  engine  sound  simulution  to  exauiine  eyeblink 
effects  in  relation  to  piloting  errors,  fyeblink  results  showed  that  the 
longer  the  closure  duration,  the  higher  tlie  error  in  airspeed,  heading  and 
altitude  during  the  prespecified  flight  course,  'urthermore,  as  the  fre¬ 
quency  of  long  duration  blinks  increased  (tnose  1  )nger  than  500  msec  in 
duntion),  error  also  increased.  Morris  '1906)  f  irther  suggested  that 
the>e  eyeblink  i.easures  can  be  used  to  pr^'dict  mistakes  in  Might  perform- 
ance.  Errors  iri  airspeed,  aeading  and  altitude  were  preceded  by  increases 
in  blink  duratii>n  far  enougn  in  advance  to  become  candidates  for  the  valid 
prediction  of  “catastrophic  failjre."  Eyeblink  changes  occurred  before 
performance  decrements  were  found. 

The  above  results  document  the  use  of  eyeblink  measures  in  simulation  and 
actual  flight.  These  measures  proved  useiul  in  ol'taining  information  about 
pil')t  versus  copilot  attentional  demands,  task  locds,  and  investigations  of 
EOG  as  predictors  of  flying  performance  decrement*. 

Electroencephalography  (or  LEG) 

Perhaps  the  most  intuitively  appealing  physiological  measure  is  that  of 
brain  activity.  If  the  cognitivi;  demands  on  an  operator  are  of  intiirest, 
surely  the  on-going  ar.tivity  of  the  l)rain  must  offer  insight  into  mental 
workload.  In  practice,  howi  ver,  it  has  been  fourul  that  the  LEG  does  not 
offer  this  insight  easily.  Difficulties  arise  with  detecting  the  extremely 
small  EEG  signal  (on  the  order  of  5-20  microvolts)  from  the  liunan  scalp.  In 
some  cases  ampM  f  i  cat  i  on  of  the  I.EG  must  iie  as  large  as  100,000  times  the 
original  signal.  When  this  problem  is  overcome,  LEG  techniques  can  be 
useful  (O'Donnell,  1979). 

On-going  EEG  obtained  during  actual  aircraft  and  simulator  flights  has  been 
submitted  to  spectral  analysis  and  correlated  witii  mission  event  as  well  as 
flight  formation  position  (Skelly  el  al.,  1907;  IJMson  et  al.,  1907).  The 
4-7.5  W/.  I)and,  the  0-11  lly  band,  the  14-19.5  llx  liand  and  the  20-00  11/  band 
of  tiie  LEG  spectra  showed  increased  activity  during  the  limid  and  wing  air¬ 
craft  flights  ov'.-r  that  found  during  the  simulator  flight.  I  urthermore. 
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While  these  results  are  pruiiii  s  i  tuj ,  Wilson,  et  al.  (1987)  C'^utioned  dydinst 
too  strong  of  an  i  nterpretati  on.  Prohleiiis  with  obtdimng  the  thG  siyndl 
steiniiied  from  tl)e  electriedlly  noisy  environment  of  tne  aircraft  (coupled 
with  movement  artifact)  not  found  in  simulation.  Tiiis  intreased  noise 
could  easily  have  caused  tlie  increased  activity  of  the  LLU  signal,  unre¬ 
lated  to  any  cognitive  functions  of  tfie  pilots.  Wilson,  et  al.  (  1987) 
recommended  changes  in  t.LG  collection  techniques,  specifically  larger 
amplification  of  the  LEG  signal  closer  to  tlie  point  of  the  electrical 
source.  Presently,  stronger  preamplifiers  located  within  inciies  of  the 
scal|)  contacts  arc'  being  tested  on  pilots  flying  F-4  aircraft. 

When  these  problems  of  signal  noise  have  iieen  controlled,  suectral  analyses 
of  on-going  EKG  signals  have  proven  to  be  generalized  measures  of 
arousal.  Stersian,  bchuimer,  lJushenko,  and  Smith  (1987)  found  that  8-il  Hz 
amplitude  discriminated  between  pilots  during  resting  and  when  flying  an 
airplaiK'.  Furtlieniiore ,  sensorimotor  cortex  scalp  sites  stowed  higher 
amplitude  responses  in  the  8-11  Hz  band  during  controlled  flight  tasks  than 
the  visual  cortex  scalii  sites.  These  results  point  out  tie  usefulness  of 
on-going  LEG  measun-s,  especially  wfien  used  to  investiyati'  differences 
between  aircraft  and  simulation  flights,  and  fask/no-task  situations. 

On-(joing  EEG  tloes  not  hnd  itself  well  to  answering  more  specific  questions 
about  flight  tasks.  A  tcn.hniquc  known  as  the  averaged  ev  iked  potential 
(EP)  has  been  used  extensively  in  the  laboratory  to  answe  '  very  specific 
questions  about  task  lotids.  Tin  technique  consists  of  taiing  one  second 
"snap-shots"  of  the  on-ioing  EEG  potentials  tliat  occur  in  response  to  dis¬ 
crete  stimuli,  and  then  superimposing  these  snapshots  one  upon  the  other  to 
obtain  an  average  EP.  The  technique  is  limited  by  the  requirement  of 
multiple  occurrences  of  tne  discrete  "evoking"  stimuli  to  obtain  multiple 
snap-shots  for  the  aver.ige  EP.  The  recommended  number  of  snap-shots 
required  to  obtain  a  reliable  average  EP  has  ranged  from  10  to  lOU 
(Wickens,  Kramer,  Vanasse,  and  bonchiri,  1983).  In  some  situations,  tlie 
evoking  stimuli  do  not  uccur  often  enough  to  obtain  a  "reliable"  average. 


For  exdiiple,  All  ery  (198H)  oolained  i  l-’s  olicitod  truia  both  <i  primary  and 
sec  )ndary  task  \,hile  pilots  were  under  centripetal  force  in  a  in'gh-G  siniu- 
lat)r.  The  nuiiil  or  of  sna[)- >hots  availabli;  tor  thi-  fl’  averages  ranged  from 
1  til  22  (nean^ll,  std  3).  .Tiber/  (19^8)  identified  tv;o  major  problems  that 
cau '.ed  many  of  these  single  ti'ial  sruip-shots  to  i)'’  lost:  (1)  excessive 
eyeilink  contamination  during  hijh-G  stre.s,  and  2)  electrical  noise  gen¬ 
erated  by  tiie  mttion-based  :entrifuge  appiratus.  It  is  interesting  to 
note,  however,  that  results  obtained  from  these  LI'  averages  still  matched 
the  a  priori  hyi  othes.-s  of  the  a.itlioi  .  Toe  components  of  the  EPs  to  the 
primary  trackin'  task  increised  in  amplitude  and  latency  as  the  difficulty 
of  the  task  inci  eased.  I  urtiier;i, ore ,  the  '.omponent.s  of  the  LPs  to  the 
secondary  target  acquisitioi  tas<  increaseij  in  latency  as  the  number  of 
tar  jets  increasid.  Tnis  is  evidence  that,  even  though  LP  signals  :riay  be 
noisy  and  contai  inated  by  artifacts  in  motion-based  simulators  and  actual 
flijht,  this  me.  sure  an  still  be  useful. 

In  I  more  ideal  situation,  'trainer,  Sirevaig,  and  '.raun  (1987)  obtained  LPs 
elitited  by  a  st condary  "oddball"  task  during  the  performance  of  a  simu¬ 
lated  flight  mi' Sion.  The  simulation  apparatus  was  fixed-liased  and  did  not 
cause  large  EP  • ignal  contamination,  and  any  eyeblink  artifacts  could  tie 
mathemati ca 1 ly  i orrected  by  a  technique  reported  by  Grafton,  Coles  and 
llorichin  (19H3).  When  the  diffu.ulty  of  toe  pnmaiy  flight  task  was 
increased  by  inl  roducmg  tu'fiulence,  subsystem  f.ii  lures,  and  increasing 
wind  Sfieed,  the  compoaents  of  the  LPs  elieited  liy  the  secondary  task 
(oddball  tones)  decre.ised  in  amplitude. 

Since  the  SABLP  laboratories  contain  a  fixed-based  simulation  capability, 
the  electrical  noise  inherent  in  actual  airplane  cockpits  and  aiot i on-based 
simulators  should  not  be  a  problem.  Lvoked  potentials  should  be  relatively 
artifact  free  and  easy  to  obtain.  The  secondary  task  discussed  above  (the 
oddball)  seems  to  be  a  good  candidate  fur  indexing  the  difficulty  of  flight 
tasks.  Also,  eliciting  LPs  with  discrete  occurrences  of  task  relevant 
stimuli,  such  a.  low-level  i‘merg(*n(.y  tone'.,  could  prove-  useful  in  evalu- 
-itini]  flight  ta'.ks.  i  in. ill/,  on-gijing  l.l  G  '.pei.tr.il  an.il/ses  have  been  used 
to  determine  ov"rall  arous.il  levels  of  tlu-  operator'. 
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